Papers with supervised entailment models
Localizing Factual Inconsistencies in Attributable Text Generation (2026.tacl-1)
Copied to clipboard
Arie Cattan, Paul Roit, Shiyue Zhang, David Wan, Roee Aharoni, Idan Szpektor, Mohit Bansal, Ido Dagan
| Challenge: | Existing methods for detecting hallucinations in model-generated texts fail to pinpoint errors. |
| Approach: | They propose a formalism for localizing factual inconsistencies in attributable text generation . they propose to decompose the generated text into simple question-answer pairs . |
| Outcome: | The proposed method achieves substantial inter-annotator agreement while achieving a substantial consistency score. |
DocLens: Multi-aspect Fine-grained Medical Text Evaluation (2024.acl-long)
Copied to clipboard
Yiqing Xie, Sheng Zhang, Hao Cheng, Pengfei Liu, Zelalem Gero, Cliff Wong, Tristan Naumann, Hoifung Poon, Carolyn Rose
| Challenge: | Medical text generation systems are widely used to assist with administrative work and highlight salient information to support decision-making. |
| Approach: | They propose a set of metrics to evaluate completeness, conciseness, and attribution of medical text at a fine-grained level. |
| Outcome: | The proposed framework exhibits substantially higher agreement with medical experts than existing metrics. |